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This invention relates to a system comprising a 
computeo a display unit comprising a screen, and 
an inputting device for selection of specific areas 
on the screen and for moving a cursor on said 
screen, the inputting device being coupled to the 
computer in which there is at least one screen- 
controlled program (interactive program), a pro- 
gram seeing to it that selectable elements are 
displayed on the screen at places corresponding 
to the specific areas, and it baing possible to bring 
the cursor to a selectable element by means of the 
Inputting device, so that a sub-program sym- 
bolized by said element can be selected by oper- 
ating a selection key on the inputting device, the 
inputting device further comprising a tactile 
element to output information. 

A system of this kind Is used in many places 
where information has to be processed on a 
screen, for example in CAD systems, word pro- 
cessors, or graphic workstations. Systems of this 
kind operate with menu-controlled programs in 
which a number of commands selectable at a 
given time in the program are displayed at a 
special place on the screen. The use can move a 
cursor over the screen by means of an inputting 
system, and If the cursor is placed on a command 
or icon that command can be selected. The 
inputting unit is frequently a so-called "mouse" 
coupled ot the computer system. By moving the 
mouse over a flat surface the cursor can be 
positioned to any required place on the screen. 
The mouse is also provided with one or more 
press-buttons for selection of a command. If the 
cursor position coincides with the position where 
a command is displayed pressure on the bottom 
will start the sub-program to be performed under 
that command. This subprogram may, for 
example, provide a new menu display or a so- 
called pop-up menu. Such a mouse, further 
involving tactile perception of screen contents for 
the blind, is known from the disclosure of IBM, 
TDB, Vol. 28, No. 3, pages 1343—1344, dated Aug. 
85. 

Using such mouse-controlled menu programs 
requires high concentration visually of the user. 
Particularly if the areas for selection are small, it is 
rather difficult to get the cursor exactiy in the 
required area and to actuate the selection button 
at the correct moment 

The object of the invention is accordingly to 
provide a system according to the preamble in 
which this disadvantage is obviated. According to 
the invention, this object is attained in a system 
according to the preamble, in that when the 
position of the cursor coinddes with the position 
of a selectable element the computer delivers a 
signal to the inputting device, said output tactile 
element being activated in response to said signal 
and in that the tactile element is disposed in a 
selection key. 

Tactile feeidback makes use of the touch recep- 
tors and/or pressure receptors in the hand, so that 
the amount of attention required particulariy for 



the central part of the field of view of the eyes can 
be relieved. This means a more tialanced distribu- 
tion of the offered infonnation over the various 
senses. Although extra attention is called for on 
5 the part of the touch receptors in the fingers, the 
intensively used eyes wii! hecome less tired and 
the total strain will be reduced when using the 
system. 

The use of the simultaneous feedback of visual 
10 and tactile information also results in a form of 
redundancy which benefits the error-sensitivity of 
the mouse usage. Reaction time can also be 
reduced by the tactile feedback. Thus tactile feed- 
back eliminates retinal delay, which is involved 
18 when the visual channels are used. With the skin 
receptors there is a more rapid transmission of 
information to the brain. Tactile feedback can also 
result in a kind of reflex on the following lines: 
tactile element moves— actuate button, so that 
20 relatively rapid response times can be obtained. 
In the inputting of commands with which the 
situation on the screen changes considerably, it 4s 
sometimes necessary for the user to wait until the 
prompt re-appears as an indication that the infor- 
ms mation has been processed and the screen 
adjusted. This necessary wait is also due to the 
fact that the software for the Image processor 
which is responsible for refreshing the screen 
requires some time to process new information. If 
30 the user receives a tactile signal at the instant that 
the information has been processed, but before 
the instant that the information processing for 
screen refreshment has started, the waiting time 
can be saved because the user can continue 
3S operations tiefore the screen is refreshed. 

These and other advantages of the invention 
will be explained with reference to the drawings 
wherein: 

Rg. 1 is an embodiment of a mouse as used in a 
40 system according to the invention, 

Rg. 2a to f show the use of said mouse, 
Rgs. 3a and b show the use of the mouse in 
selecting one pbcel thick lines and 
Rgs. 4a en ^ represent a <iidgrem ehowtng the 
4$ principle of a tactile element as used in a system 
according to the invention. 

Rg. 1 shows an inputting device of the system 
according to the invention. This inputting device 
or mouse 10 has a baseplate 1 1, the base of which 
50 is provided with sensors which, when the mouse 
is moved over a flat surface, casus the cursor on 
the screen to move in a corresponding direction. 
The mouse is connected by e cord 12 to a 
computer in which an inter-active program is 
fi? running. The mouse has two press-buttons (selec- 
tion keys) 13, 14, the operation of which will be 
described hereinafter. €ach button <x>ntains a 
tactile element 15 and 18 respectively in the form 
of a pin which under certain conditions can 
60 project slightly above the top of the botton. 

The operation of this mouse will be described in 
detail with reference to Rgs. 2a to 2f. InTig.^a, 
two specific areas 21, 22 for selection are shown 
• on s screen 20. A cursor 23 in the form of a small 
^ arrow is also situated on this screen. Next to this 
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screen 20 the buttons 14 and 13 of the mouse are 
shown diagrammatically in their initial positions. 
By moving the mouse in the correct direction the 
cursor 23 is brought to the area 21 for selection. 
The user's fingers rest on the buttons 14, 13. 
When the tip of the cursor 23, i.e. the hot spot, 
enters the area 21 for selection <Fig. 2b) the tactile 
element 16 in button 14 rises and signals to the 
user that the area 21 has been reached. The user 
then presses button 14 down (Rg. 2c) in order to 
select the field symbolized by area 21. After 
selection the user allows the button 14 to rise. By 
then pressing in the button 13 (Rg. 2d) it is 
possible to call up a so-called pop-up menu 25 
which shows a number of possible operations to 
be performed on area 21. The cursor jumps to a 
standard position (default position) in this menu 
('OPEN'). The tactile element 15 of button 13 rises 
when the button 13 Is pressed in. As long as 
button 13 is pressed in, the pop-up menu 25 is 
visible on the screen 20. The cursor 23 can be 
brought to a different position in the menu by 
moving the mouse in order to select a different 
command required. If the cursor 23 is brought to 
the command 'CUT (Rg. 2e), the tactile element 
15 will go down just before the cursor leaves a 
command, and then rises again when entering 
the next command, if the button t3 is released 
(Rg. 2f) after reaching the command 'CUV 27, this 
command is performed on the selected area 21 so 
that area 21 disappears from the screen 20. The 
tactile element 15 descends again beneath the 
surface of the button 13. 

When a command of this kind is performed. In 
the situation as shown in Rg. 2a the cursor 23 can 
be moved towards the area 21 without intenshre 
use of the eyes. All that is necessary is for the user 
to know the overall screen layout to be able to 
perform a positioning movement of this kind, 
since he can rely on information from the peri- 
pheral area of the eyes and the tactile feedback 
when area 21 is reached. Thus there is no need for 
the user to fix this attention on cursor 23 and 
follow it Once the situation is reached as shown 
in Rg. 2b, the user can react automatically by 
immediately pressing in the button where the 
tactile element is perceptible so that the selection 
of the relevant command takes place. 

After the pop-up menu has been called up, 
giving the situation shown in Rg. 2d, a user 
familiar with this pop-up menu can basically find 
the command 'CUT blindly. He knowns that as 
soon as the pop-up menu has been called up the 
tactile element in button 13 becomes perceptible 
in the default position (pre-set command) and 
that there must then be another two perceptible 
stimuli on the upward movement of the cursor 23 
before the command 'CUT Is reached. If after 
calling up the pop-up menu the user for the third 
time feels the tactile element against his finger 
(OPEN-COPY-CUT) then the situation shown In 
Fig. 2e has been reached and by releasing the 
button 13 he can acth^ate the command 'CUT to 
give the situation shown in Fig. 2f. 

The tactile feedback is particularly important if, 



for example, it is necessary to select a frame line 
having a thickness of one pixel, fig. 3a and b 
show the line 30 for selection displayed on a 
screen 31. Just one pixel of the cursor 23 (the 

6 extreme tip of the arrow in this case) govenfis the 
position of the cursor 23 as recorded by the 
computer and this one pbcel must come exactly 
on the one-pbcel thick line 30. Selection by means 
of a tactile feedback takes place by moving the 

10 cursor in the direction of the required object 
When It becomes perceptible that the cursor is on 
the frame lirie 30, an immediate response is 
possible by pressing in the button is which the 
tactile element becomes perceptible, so that the 

IS object can be selected with great accuracy. 

Rgs. 4d and b represent a diagram showing the 
principle of a tactile element as used in the 
invention. A pin 40 is disposed on a compression 
spring 41 in a button 44. The pin 40 is of 

20 magnetizable material. Disposed around the pin 
40 is core 43 with a coil 42 therearound. By 
passing a d.c. through the coil the pin 40 remains 
in the core and hence beneath the surface of the 
button 44. By (temporarily) disconnecting the 

25 current the spring 41 presses the pin 40 out of the 
surface of the button 44. 

A large number of emt>odiments are possible to 
give the same effect as described above using 
electromagnetism. For example, the spring 41 can 

30 be replaced by a leaf spring or the pin can be 
constructed as a hinged construction. The fram- 
ing can also be such that the pin is raised if the 
coil is energized. 
Another embodiment of the tactile element can 

35 be obtained by means of a piezoelectric element 
This comprises a bimorphous rod on which the 
pin rests. By applying a voltage across the 
bimorphous rod a defelection occurs in the rod 
and can cause the pin to move. 

40 In yet another embodiment of the tactile 
element, a piezoelectric disk is used which is 
disposed on the selection button. This disk can be 
vibrated. 

Instead of the tactiJe element being moved 

4$ upwards only once during selection, it is possible 
to vibrate it at a frequency of between 10 Hz and 
500 Hz for the entire duration of the selection or 
white the cursor coincides to the special area. This 
is very advantageous particularly in embodi- 

50 ments in which a piezoelectric element is used. A 
frequency of about 250 Hz gives an optimum for 
the feel at the user's fingertips. 

The invention is not restricted to the embodi- 
ments described and a skilled addressee will be 

55 able to make numerous modifications. For 
example, the entire selection button can be 
moved upwards during coincidence. The tactile 
elements may consist of more pins per button, 
which are activated uniformly. They can also be in 

60 the form of a plane or one or more linear 
elements. 

•The mouse need not be connected to the 
computer system via an electrical connection. 
Connection may also be made, for example, by an 
^ infra-red or ultrasonic element The tactile feed- 
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back may also be the opposite to the operation 
described hereinbefore. However, all these modi- 
fications and embodiments will come under the 
following claims. 

Claims 

1. A system comprising a computer, a display 
unit comprising a screen, and an inputting device 
(10) for selection of specific areas on the screen 
and for moving a cursor on said screen, the 
inputting device (10) being coupled to the com- 
puter in which there is at least one screen- 
controlled program, a program seeing to it that 
selectable elements are displayed on the screen 
at places corresponding to the specific areas, and 
it being possible to bnng the cursor to a select- 
able element by means of the inputting device 
(10), so that a subprogram symbolized by said 
element can be selected by operating a selection 
key (13, 14) on the inputting device (10), the 
inputting device further comprising a tactile 
element to output information, characterised in 
that when the position of the cursor coincides 
with the position of a selectable element the 
computer delivers a signal to the inputting device 
(10), said output tactile element being activated in 
response to said signal and in that the tactile 
element is disposed In a selection key (13, 14). 

2. A system according to claim 1 characterised 
In that the tactile element comprises a piezoelec- 
tric element 

3. A system according to claim 1 characterised 
In that the tactile element comprises an elec- 
tromagnetic element 

4. A system according to any one of the preced- 
ing claims characterised in that the tactile element 
comprises a pin (40) which, on activation of the 
element, projects above the surface (44) of the 
Inputting device (10) or selection key (13, 14). 

5. A system according to any one of the preced- 
ing claims characterised in that the tactile element 
is vibrated for a given time during coincidence of 
the positions. 

6. A system according to daim 5, characterised 
in that the vibration frequency is preferably 
between 10 Hz and 500 Hz. 

7. A system according to claim 6, characterised 
In that the vibration frequency Is 250 Hz. 

PatentansprQche 

1. System mrt einem Computer, einer einen 
Bildschirm aufweisenden Anzeigeeinhett und 
einem EingabegerSt fOr die Auswahl bestimmter 
Bereiche auf dem Bildschirm und fOr die Bewe- 
gung eIner IVIarice auf dem Bildschirm, bei dem 
das EIngabegerdt mit dem Computer verbunden 
ist und wenlgstens ein bildschlrmgesteuertes Pro- 
gramm, ein Programm, das dafOr sorgt, daQ 
auswShlbare Elemente auf dem Bildschirm an 
den bestlmmten Bereichen entsprechenden Stet- 
len dargestellt werden, yorhanden ist wobei es 
mdglich ist, die Marke mi't Hilfe des Elngabeger§- 
tes (10) zu einem auswahlbaren Element zu brin- 



gen, so daB ein durch dieses Element symboli- 
siertes Unterprogramm durch Betfitigen einer 
WBhitasta (13, 14) auf dem €ingabegerdt (10) 
ausgewihit werden kann, wobei das Elngabege- 

5 rdt auBerdem ain taktilas 'Element zur Ausgabe 
von Informationen aufweist, dadurch gekenn- 
zeichnet, daB der Computer ein Signal an das 
EingabegerSt <10) Obermtttett wenn die Position 
der Martce mit der Position aines auswdhlbaren 

10 Elements zusammenfSlt daB taktile AusgalM- 
Element auf dieses Signal hin aktivlert wird und 
daB das taktile Element in einer Wfihitaste (13, 14) 
angeordnet ist 

^ 2. System nach Anspruch 1, dadurch gekenn- 

16 zeichnet, daB das taktile Element ein piezoelektri- 
sches Element aufweist 

3. System nach Anspruch 1, dadurch gekenn- 
zelchnet daB das taktile Element ein elektroma- 
gnetisches Element aufweist. 

20 4. System nach einem der vorstehenden 
Anspruche, dadurch gekennzelchnet, diB das tak- 
tile Element einen Stift (40) aufweist der bei 
Aktivierung des Elements Ober die OberflSche 
(44) EingabegerStes (10) oder der WShltaste (13, 

2S 14) hinaus vorspringt. 

5. System nach einem der vorstehenden 
AnsprOche, dadurch gekennzeichnet, daB das tak- 
tile Element fOr eine bestlmmte*Zeit wShrend des 
Zusammenfallens der Positionen zu Schwingun- 

30 gen enregt wird. 

6. System nach Anspruch 5, dadurch gekenn- 
zeichnet daB die SchwingUngsfreqiienz vorzugs- 
weise zwischen 10 Hz und 500 Hz liegt 

7. System nach Anspruch 6, dadurch gekenn- 
3B zeichnet daB die Schwingungsfrequenz 250 Hz 

betrdgt 
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Revendications 



1. Systems comprenant un ordlnateur, une 
unlt6 d'affichage comportant un 6cran, et un 
dlsposHif d'entrde (10) servant i s6lectionner des 
zones sp6ciflques sur T^cran et h ddplacer un 
curseur sur ledit ^cran, le dispositif d'entrte ^10) 
4S dtant accouptd k Tordinateur, dans lequel 11 est 
pr§vu au moins un programme command^ h 
partir de I'^cran, un programme Indiquant que 
des dtdments pouvant §tre sdlectionn6s sont 
affichdis sur Tteran en des emplacements corres- 
50 pondant aux zones spSclflques, le curseur pou- 
vant Stre amend sur un dldment pouvant dtre 
sdlectionnd au moyen du dispositif d'entrto (10) 
de sorte qu'un sous-programme symbolist par 
ledit 6i6ment peut dtre s6lectionn6 au moyen de 
ss ractionnement d'une touche de selection (13, 14) 
sttu^B sur le dispositif d'entrde (10) ce dernier 
comprenant en outre un 6l6ment tactile servant k 
dSllvrer une information, caract6ris6 en ce que, 
lorsque <a position du curseur coTndde avec la 
GO position d'un dldnrient pouvant dtre s6lectionnd, 
I'ordlnateur envoie un signal au dispositif d'en- 
trde (10), ledit didment tactile de sortie tont 
activ§ en rdponse audit signal, et en ce que 
r^tdment tactile ast dispose dans une touche de 
65 selection (13, 14). 
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2. Systdme selon la revendication 1, 
caract6ri86 en ce que r6l6ment tactile com- 
porte un ^I6ment ptdzo^lectique. 

3. Systdme selon la revendication 1 , 
caract6ri86 en qe que Tdl^ment tactile com- 
porte un ^Idment dIectromagnMque. 

4. Systdme selon I'une quelconque des 
revendicatlons prec^dentes, caract6ris6 en ce 
que {'Element tactile comporte une broche 
(40) qui, lors de Tactivation de I'^ldment, fart 
saillie au-dessus de la surface (44) du dispo- 
sitrf d'entr^e (10) ou de la touche de selec- 
tion (13, 14), 



€. Systdme selon I'une quelconque des 
revendtcations pr6c6dentes, caract^risd en ce 
que r6t6ment tactile vibre pendant un inter- 
vatle de temps donn6, pendant la coincidence 
5 entre les positions. 

6. Systdme selon la revendication 5, 
caract6ris6 en ce que la frequence de vibra- 
tion est de preference connprise entre 10 Hz 
etSOOHz. 

10 7. Systdme selon la revendication 6 
caracterise en ce que la frequence de vibra- 
tion est egale k 250 Hz. 
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